Applying Machine Translation Metrics to Student-Written Translations
نویسندگان
چکیده
This paper discusses preliminary work investigating the application of Machine Translation (MT) metrics toward the evaluation of translations written by human novice (student) translators. We describe a study in which we apply the metric TERp (Translation Edit Rate Plus) to a corpus of student-written translations from Spanish to English and compare the judgments of TERp against assessments provided by a translation instructor.
منابع مشابه
The Correlation of Machine Translation Evaluation Metrics with Human Judgement on Persian Language
Machine Translation Evaluation Metrics (MTEMs) are the central core of Machine Translation (MT) engines as they are developed based on frequent evaluation. Although MTEMs are widespread today, their validity and quality for many languages is still under question. The aim of this research study was to examine the validity and assess the quality of MTEMs from Lexical Similarity set on machine tra...
متن کاملApplying Referenceless MT Evaluation Metrics to a Multi-Engine MT System
Recent work in the area of automatic machine translation evaluation has led to the development of metrics that have equivalent levels of performance with standard metrics, yet do not rely on the existence of human generated gold standard reference translations. To achieve this performance, alternative machine generated translation are used in place of the human references. A seemingly natural a...
متن کاملAn experiment in comparative evaluation: humans vs. computers
This paper reports results from an experiment that was aimed at comparing evaluation metrics for machine translation. Implemented as a workshop at a major conference in 2002, the experiment defined an evaluation task, description of the metrics, as well as test data consisting of human and machine translations of two texts. Several metrics, either applicable by human judges or automated, were u...
متن کاملQuality Assessment of English-into-Persian Translations of Tourism Management Academic Textbooks
This paper addresses the quality of the Persian translations of 32 English tourism textbooks. The qual- ity was assessed at sentence-level and page-level by the researchers and from the viewpoint of a tour- ism management student. In Phase 1, the quality of one randomly selected sentence from each text- book was assessed applying Hurtado Albir‘s analytical model; two were acc...
متن کاملLost in Translation: the Problems of Using Mainstream MT Evaluation Metrics for Sign Language Translation
In this paper we consider the problems of applying corpus-based techniques to minority languages that are neither politically recognised nor have a formally accepted writing system, namely sign languages. We discuss the adoption of an annotated form of sign language data as a suitable corpus for the development of a data-driven machine translation (MT) system, and deal with issues that arise fr...
متن کامل